Systems, methods, and media for creating multiple layers from an image

ABSTRACT

A process for creating a composite picture with a plurality of parts extrapolated from an input picture. The process includes analyzing a picture for color content to detect at least one dominant color in the picture and for shape recognition to detect at least one object in the picture and generating a concentric grid for the input picture based on the color content analysis and the shape recognition for a depth calculation of the input picture. The concentric grid includes a center point, a plurality of lines that radiate from the center point, and a plurality of concentric circles that expand at a spatial distance in the picture, dividing the input picture into a plurality of sections, each representing an equal spatial depth. The process further includes generating a plurality of partial pictures using at least two of the plurality of sections.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.13/902,173, filed on May 24, 2011, now U.S. Pat. No. 8,774,562.

U.S. patent application Ser. No. 13/902,173 is a continuation of U.S.patent application Ser. No. 13/233,216, filed on Sep. 15, 2011, now U.S.Pat. No. 8,467,601, which claims the benefit under 35 U.S.C. §119(e) ofU.S. Provisional Patent Application No. 61/383,022, filed on Sep. 15,2010, each of which is hereby incorporated by reference herein in itsentirety.

BACKGROUND

Existing photo editing application programs lack features that enableusers to generate and manage layers from a photographic image.Presently, the users have to manually create individual layers. In orderto print the layers individually, the users must either save the layersin separate files or hide individual layers saved in a file to isolatethe one intended for printing, and print each layer separately. If it isdesired to edit the image, the user must either manually generateindividual layers from the photographic image, in which some elements ofthe image may become unable to edit (e.g., text would become an imageobject), or create the layers from scratch, hoping that the changes madeto the individual layers will roughly correspond to the editing made tothe original photographic image.

Furthermore, while the existing photo editing application programsenable the users to create manually an individual layer by selecting,cutting, and then pasting one or more objects in the photographic image,in printing they often fill the rest of the individual layer with asingle default background color (e.g., white background, etc.),resulting in loss of translucence and nuance.

SUMMARY

Systems, methods, and media for creating multiple layers from an imageare provided. The disclosed subject matter enables automatic generationof multiple layer images from an input image based in part on depthcalculations for the input image.

In one embodiment, a method for creating a plurality of layer imagesfrom an input image is provided. The method includes analyzing an inputimage for color content to detect at least one dominant color in theinput image and for shape recognition to detect at least one object inthe input image. The method also includes generating a concentric gridfor the input image based on the color content analysis and the shaperecognition for a depth calculation of the input image. The concentricgrid includes a center point, a plurality of lines that radiate from thecenter point, and a plurality of concentric circles that expand at aspatial distance in the input image, and the concentric circles dividethe input image into a plurality of sections, each of which representsan equal spatial depth. The method further includes generating aplurality of layer images using at least two of the plurality ofsections. An order of the plurality of layer images in the method may bedetermined by a direction of perceived depth based on the depthcalculation.

The method may further include analyzing the input image to determine atleast one of a horizontal horizon line and a vertical horizon line inthe input image based on at least one of the color content analysis andthe shape recognition, wherein the horizontal horizon line and thevertical horizon line are used to determine the center point of theconcentric grid.

The method may further include calculating a degree of shadow on each ofthe at least one object in the input image detected through the shaperecognition by analyzing pixel data of each of the detected at least oneobject and comparing a percentage of color change of each detectedobject to its neighboring objects.

The method may further include determining a light source direction anda light source angle of the input image by comparing and analyzingshadow color gradient of the at least one object detected through theshape recognition.

The depth calculation in the method may include using ratios of spatialdimensions of an outermost section of the plurality of sections tospatial dimensions of inner sections of the plurality of sections thatare closer to the center point.

The shape recognition in the method may be performed using a shapelibrary that includes a series of geometric shapes and patterns, aseries of combinations of shapes, and a series of letters and text. Thecolor content analysis in the method may be performed using a colorlibrary that includes a spectrum of colors, a color saturation scale,and a color intensity scale.

Analyzing the input image for the shape recognition to detect the atleast one object in the input image in the method may includecorrelating a detected shape to at least one already recognized objectwithin the input image to determine if the detected shape matches nearobjects. The input image of the method may include a monochromatic imageand wherein, if the at least one dominant color in the monochromaticimage is detected throughout more than a predetermined percentage of themonochromatic image, analyzing the monochromatic image for shaperecognition includes desaturating the monochromatic image to detectshapes based on shape outlines and resaturating the monochromatic image.

In another embodiment, a system for creating a plurality of layer imagesfrom an input image is provided. The system includes a memory capable ofstoring data and a processor. The processor is coupled to the memory andconfigured to use the data such that the system can analyze an inputimage for color content to detect at least one dominant color in theinput image and for shape recognition to detect at least one object inthe input image. The processor can also generate a concentric grid forthe input image based on the color content analysis and the shaperecognition for a depth calculation of the input image. The concentricgrid includes a center point, a plurality of lines that radiate from thecenter point, and a plurality of concentric circles that expand at aspatial distance in the input image, and the concentric circles dividethe input image into a plurality of sections, each of which representsan equal spatial depth. The processor can further generate a pluralityof layer images using at least two of the plurality of sections.

In another embodiment, a non-transitory computer readable storage mediumstoring computer executable instructions is disclosed. The computerexecutable instructions, when executed on a processor, can cause theprocessor to perform a method for creating a plurality of layer imagesfrom an input image. The method includes analyzing an input image forcolor content to detect at least one dominant color in the input imageand for shape recognition to detect at least one object in the inputimage. The method also includes analyzing the input image to determine ahorizontal horizon line and a vertical horizon line in the input imagebased on the color content analysis and the shape recognition, whereinthe horizontal horizon line and the vertical horizon line are used todetermine a furthest point in the input image. The method also includesgenerating a concentric grid for the input image using the furthestpoint for a depth calculation of the input image. The concentric gridincludes a center point, a plurality of lines that radiate from thecenter point, and a plurality of concentric circles that expand at aspatial distance in the input image, and the concentric circles dividethe input image into a plurality of sections, each of which representsan equal spatial depth, wherein the center point is determined based onthe furthest point and wherein the depth calculation includes usingratios of spatial dimensions of an outermost section of the plurality ofsections to spatial dimensions of inner sections of the plurality ofsections that are closer to the center point. The method furtherincludes generating a plurality of layer images using at least two ofthe plurality of sections, wherein an order of the plurality of layerimages is determined by a direction of perceived depth based on thedepth calculation.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating a system that can be used forcreating a plurality of layer images from an input image in accordancewith some embodiments of the disclosed subject matter.

FIG. 2 is an illustrative diagram of a process for creating a pluralityof layer images from an input image in accordance with some embodimentsof the disclosed subject matter.

FIG. 3 is an illustrative image showing a concentric grid generated fordepth calculations in accordance with some embodiments of the disclosedsubject matter.

FIG. 4A-B are illustrative images showing a photo editing interface forediting a selected image in accordance with some embodiments of thedisclosed subject matter.

FIG. 5A-B are illustrative images showing a video editing interface forediting a video frame in accordance with some embodiments of thedisclosed subject matter.

FIG. 6 is an illustrative diagram showing a selection interface forselecting one or more of multiple layer images in accordance with someembodiments of the disclosed subject matter.

FIG. 7A-B are illustrative diagrams showing a lighting map interface forplacing lighting effects on an image in accordance with some embodimentsof the disclosed subject matter.

FIG. 8 is an illustrative diagram showing a color gel selectioninterface for selecting color gels and other filters in accordance withsome embodiments of the disclosed subject matter.

FIG. 9 is an illustrative image showing a gallery view interface forselecting input images in accordance with some embodiments of thedisclosed subject matter.

FIG. 10A-B are illustrative images showing the gallery view interfaceacting as a contact sheet for image enlargement and comparison inaccordance with some embodiments of the disclosed subject matter.

FIG. 11A-B are illustrative diagrams of a device embodying a system forcreating multiple layer images from an input image in accordance withsome embodiments of the disclosed subject matter.

DETAILED DESCRIPTION

Systems, methods, and media for creating multiple layers from an imageare provided. In some embodiments of the disclosed subject matter,systems, methods, and media are provided for automatically creatingmultiple layers from an input image, e.g., to print the multiple layerson media, such as transparencies, and present the printed layers withthe perception of depth, e.g., by housing the printed layers inshadowboxes and/or frames.

FIG. 1 is a block diagram illustrating a system 100 that can be used forcreating a plurality of layer images from an input image in accordancewith some embodiments of the disclosed subject matter. Referring to FIG.1, system 100 includes a processor 101, a memory 103, an image sensor105, and a display screen 107. In some embodiments, system 100 alsoincludes a built-in projector 109 for projecting screen views displayedon display screen 107.

Processor 101 may be a general-purpose processor, a special purposeprocessor, or an embedded processor of any architectures known in theart, including reduced instruction set computer (RISC) or complexinstruction set computer (CISC) processor architecture. Memory 103 maybe of any types of memory known in the art, including read only memory(ROM), such as programmable read only memory (PROM), erasable PROM(EPROM), electrically erasable PROM (EEPROM), and flash memory (e.g.,NAND flash, NOR flash), and random access memory (RAM), such as staticRAM (SRAM) and dynamic RAM (DRAM). Image sensor 105 may be acharge-coupled device (CCD) based image sensor or a complementary metaloxide semiconductor (CMOS) sensor. Display screen 107 may be a cathoderay tube (CRT) display, a liquid crystal display (LCD), or a plasmadisplay.

System 100 may be implemented in one of various electronic or computingdevices, such as a hand-held device, a digital camera, a desktop, alaptop, a workstation, an enterprise server, and other general- andspecial-purpose electronic and computing devices. In some embodiments,system 100 is implemented using a touch screen tablet. The touch screentablet may be configured to serve as a full-service professionalphotography station with functionalities, such as photo editing andprinting capabilities. In some embodiments, a photo layering applicationis installed and run on system 100 to create multiple layers from aninput image.

FIG. 2 is an illustrative diagram of a process 200 for creating aplurality of layer images from an input image in accordance with someembodiments of the disclosed subject matter. FIG. 3 is an illustrativeimage 300 showing a concentric grid generated for depth calculations.FIGS. 2 and 3 will be referenced together in providing the details ofprocess 200.

Referring to FIG. 2, at 201 a color content analysis is performed on aninput image. In some embodiments, a color content analysis is performedto detect one or more dominant colors in the input image. For example,dominant colors may be used as indicators to determine the farthestpoint in the input image. For instance, a background of an input image,such as the sky in image 300, may be used to determine the farthestpoint. In some embodiments, number and/or placement of pixels (e.g., 325or more pixels having a same color, 64 adjacent pixels having a samecolor) are used for determining one or more dominant colors.

At 203, a shape recognition analysis is performed on the input image. Insome embodiments, pixels are examined individually and clustered basedon patterns that match the shapes stored in a shape library for shaperecognition, color grouping, and combinations of shapes. The input imagemay be broken down into a series of geometric shapes and patterns basedon combinations of shapes to determine objects within the image. Forexample, shape recognition and determination of color groupings andcontinuous lines may be used to determine objects within the image.

Starting from a center point of an image and radiating outward, eachpixel may be analyzed for detecting indicators, such as shapes, color,scale, and the like. For example, continuous edges, such as lines andcurves of continuous color, and clusters of color (e.g., pure hue andgradations) may be determined by examining adjacent pixels. Scale,proximity, and shape recognition may be used to group objects (e.g., arectangular object that changes midway from one color to another, etc.).

In some embodiments, in which a monochromatic image is used as an inputimage and where a dominant color is detected throughout more than acertain percentage of the image (e.g., 60%), the input image is firstde-saturated to detect shapes and separate the detected shapes based onshape outlines. The de-saturated image may then be returned to itsoriginal color saturation (i.e., re-saturated) upon completion.

In some embodiments, in which an image in translucence or transparencyis used as an input image, continuous edges detected in the image areused for object determination. For example, the outermost continuousedges may be used to determine an object's parameters and may envelop,or group, all overlapping objects that fall completely within thoseparameters. Such objects are referred to as dependent objects. Objectsoutside of this parameter, however, may be considered occluded andtreated as independent objects. Changes in color and patterns in shape adetermined by pixel comparisons and settings for the pixel comparisonscan be turned on and off by the user.

At 205, one or more horizon lines are determined. In some embodiments,the horizon lines are determined based on the color content analysisand/or the shape recognition analysis. Indicators, such as color (e.g.,a line of consecutive and adjacent pixels of ‘x’ color and ‘y’ number ofpixels wide), may be used as cues to determine a horizontal horizonline, such as horizon 307 in image 300. A horizontal horizon line may beplaced at the bottom border of the input image if no horizontal horizonline is detected within the image using color content analysis and/orshape recognition analysis. The user may also designate one or morehorizontal horizon line.

A vertical horizon line may be determined based on where the lightsource occurs by assessing the angle of the light source. The angle ofthe light source may be assessed by comparing color gradation of theobjects detected within the input image. The color gradations of thecompared objects may be integrated into the perspective of the inputimage to determine the direction in which depth occurs. A verticalhorizon line may be placed at the left or right border of the inputimage, if no vertical horizon line is detected within the frame of theinput image.

The plane of an input image may include a horizontal horizon line thatdivides a vertical horizon line. In some embodiments, the cross point ofthe horizontal horizon line and the vertical horizon line is used as thefarthest point for the image, such as point 301 in image 300.

At 207, the objects detected in the input image are analyzed for shadingand angle of light. In some embodiments, the degree of shadow on anobject is calculated by analyzing the pixel data of all detected objectswithin an input image and comparing the percentage of color changes tothat of neighboring objects. The degree of shadow of the objects in animage may be used for depth calculation. For example, if object 2 isfound to be 60% in shadow of object 1 and object 3 is found to be 25% inshadow of object 1, then object 2 may be determined to be located deeperin the image than object 3.

In some embodiments, light source direction and angle can be determinedusing the shadow color gradient of the detected objects. Indicators,such as color and color saturation (i.e., intensity of hues), may beused to examine neighboring shapes to correlate them to the alreadydetermined objects within the input image, based on the premise that thepurest and most intense colors occur in the light, with the lightest andpurest hues being closer, while shaded (or darker) variations of thathue occur in shadow and are farther away.

In some embodiments, black color is used as the default determinant forshadow. The degree in which the color of an object strays from itspurest hue toward black may be used as an indication of depth and howfar the object extends into shadow. Black objects, being of a pure huewithout variation, may be determined with color content and/or shaperecognition analysis.

Shadows may be detected by measuring shadow length and intensity, withthose that are lighter and longer being farther away and those that areshorter and darker being closer, and comparing shapes, based onneighboring patterns, to see if the shadows match objects near them.Shadows tend to be close to the objects that cast them.

There may be a corresponding shape to determine a correlating shadowthat falls on an object. A degree of distortion may be factored in toassociate objects with shadows based on the angles of the gradation ofhue from light to dark. The amount of the change in color in a shadowmay be also used as an indicator to help determine depth as well as thedistance the shadow falls from an object.

In some embodiments, a shadow's distance from the object that created itis used as an indicator of depth, and is assessed based on the directionin which the shadow falls in relation to the angle of the colorgradient. The angle of the color gradient in turn may be determined fordetermining the angle of the light source.

At 209, a concentric grid, as shown in FIG. 3, is generated for depthcalculations. Utilizing the premise that the camera angle is pointed inthe direction of the farthest point, such as point 301 in image 300, aconical web-like grid radiating from a single point (i.e., the farthestpoint) may divide the input image into sections that represent equallength and depth. The conical grid includes lines 303 that radiate fromthe center 301 of the cone and circles 305 that expand at equaldistances, thereby dividing the image. The default setting for thefarthest point may be the center of the input image. The user may alsomove and define the farthest point.

At 211, depth calculations are performed. Depth may be calculated basedon the conical grid. For example, depth may be calculated using a ratiocomparing the dimensions of outermost regions to the dimensions of thosecloser to the center point 301. In some embodiments, the ratios of thecenter point 301 of the conical grid to the placement points of thedetected objects in the grid are used as indicators to determine scaleand depth.

At 213, a plurality of layer images is created from the single inputimage. In some embodiments, the determination of which elements (e.g.,objects, etc.) are to be separated into which layer is made based onscale and by comparing the size of the detected objects. For example,smaller objects may be placed in background layers and larger objectsthat are not occluded by other objects may be placed in foregroundlayers. Objects that are occluded by other objects within the image maybe placed in the background layers and the occluding objects may beplaced forward of the occluding objects. Layers may be created for eachcomparative size until there are no more layers to create.

In some embodiments, in which text objects are present in the image,shape recognition and the angle of the lettering are used todifferentiate text objects and separate the text objects into layers. Adirection of depth determined based on the perspective of the image maybe used to order the layers.

In some embodiments, in which the input image includes a shadow that isnot connected to the object that casts the shadow by adjacent pixels,the shadow is placed in a separate layer from the object based on scaleand proximity to neighboring objects. In some embodiments, in which textobjects are present in the image, an order of the layers are determinedusing indicators related to the text objects, such as text scale, color,occlusion, and the like.

Various effects may be provided to edit the input image to make theimage look more realistic. For example, shadow distance effect may beused to create depth within a picture image when inserting new shadows.Such effects may be strewn across multiple layers. For instance, adistance setting for depth within the picture image (e.g., 2 ft., 10ft., etc.) may be selected and a line of intersection may be designatedto indicate where a shadow should bend and at what angle, as the shadowfalls across another object. The shape of the inserted shadow may betailored to the designated angles. The effects may be broken up andrendered/printed on multiple layers determined by the depth calculation.

For an illustrative example, multiple layers may be created based onimage 300 as following. For instance, the outermost layer of image 300may include person 309 on a rock 311. The next layer may include smallerrocks 313 adjacent to rock 311. The next layer may include small rocks315 that are further in the distance. The next layer may include thewater ending with horizon 307. The next, innermost background layer mayinclude the background sky 317, which dominates over 50% of the imagespace with a dominant color.

The resulting layers then may be printed and assembled in a shadowbox orframe. The layers may also be printed on transparency papers. The layersmay be separated by a glass pane, and the like. and a backlight may beused to shine light through the layers.

FIG. 4A-B are illustrative images showing a photo editing interface 400for editing a selected image in accordance with some embodiments of thedisclosed subject matter. Referring to FIG. 4A, photo editing interface400 includes a shutter 401, a jog wheel 403, jog wheel menu tabs 405A, ahistory window 407, a menu bar 409, a pull down menu 411, and a bar 413that separates interface 400 from film strip menu 415. In someembodiments, interface 400 is a touch screen interface.

Shutter 401 is the central image of photo editing interface 400 thatresembles a camera shutter for displaying an input image for editing.Jog wheel 403 provides the user with a means for selecting menu tabs405A. History window 407 shows the original image prior to edits and/orsteps selected in the edit history.

Jog wheel 403 is a feature of interface 400 that is made to create easyaccess to the function of the pull down menu 411. For example, the usermay create a palette of favorite functions and settings to reuse withease as they are working through interface 400. In some embodiments, jogwheel 403 can be customized by adding or removing menu tabs 405A, andmenu tabs 405A may be added to jog wheel 403 option by, for instance,touching the ‘x’ 417 at the top of each section of pull down menu 411.

Menus may be grouped into families of functions and touching each menutab 405A opens a list of submenus to reveal the functions. When in theshape of a wheel, as shown in FIG. 4A, jog wheel 403 may be touched at apoint to allow the user to control it like a dial to execute and controlthe degree of a selected editing function, such as history, undo,rotation, perspective, scale, distortion, saturation, opacity, cropping,previewing effects, and the like. In some embodiments, as shown in FIG.4B, menu tabs 405B are not in the jog wheel formation.

Table 1 provides illustrative menu options. These options are merelyillustrative, and any other menu options or combination of options maybe provided.

TABLE 1 File Edit View Image Open photo Undo -with keep Gallery Imagesize Open video or discard options Shoot Canvas size Save to deletesteps out Single Image Rotate canvas Save as ofsequence Print SizeAdjust Import: camera, USB source History Full screen Saturation Export:as image or video file Cut Zoom Hue Page setup Copy Split ScreenContrast Print Paste Comparison: by last Flatten image Contact sheet:batch by parameter (shoot Select edit or original, or series # -history: stages of an image as Inverse vertical or modified from open toend save with Crop horizontal display settings and effects to achievethat look. Depth calculation Layered image Can revert to each stage ifcontact sheet is Transform selected) or single image Rotate Preferences:can setup a palette of Spatial 3-D frequently used functions andsettings rotation Scale (appears in lower right comer Distort QuitPerspective Insert Layers Effects Lighting Tools Image B&W Filters*Light meter tool Object Color replacement Blur *Lighting map for LayerDesaturate: layer Sharpen professionals 3D view Effect or global Lensflare of the shoot and object Effects Shadow Artistic placement andscale; Light Emboss Lens effects: fisheye, can view in multiple Pillowemboss telescopic, panoramic angles to see a mock Bevel Finishing viewof how light Opacity would fall and Text: vertical, under whatconditions- horizontal, curved underwater, closed todimensions- set,natural light- square, triangle, sunrise, noon, dusk, sphere, circle,sunset, overcast, night rectangle -input shoots, -can plan for specs tosize contingencies exactly by font Spotlight or directional andmeasurement light Gels w/color with tracking and wheel selection 3 pointleading Merge: or multi-source linked, visible, Diffusion selected,flatten Contrast Soft box Hard image Discard light Sunlight image andsave *Wattage intensity can selected layers as be chosen by user in anew file: layered specifications or flattened

FIG. 5A-B are illustrative images showing a video editing interface 500for editing a video frame in accordance with some embodiments of thedisclosed subject matter. Referring to FIG. 5A, video editing interface500 includes a shutter 501, a jog wheel 503, jog wheel menu tabs 505A, ahistory window 507, a menu bar 509, a bar 511 that separates interface500 from film strip menu 513, and a playback window 515. In someembodiments, interface 500 is a touch screen interface. In someembodiments, as shown in FIG. 5B, menu tabs 505B are not in the jogwheel formation. As shown in FIG. 5A-B, video editing interface 500includes the same editing functions and features of photo editinginterface 400.

Under video editing mode, however, the effects of editing may beapplicable to individual video frames. The effects of editing can bealso applicable to segments of a film or to the entirety of the film.For example, segments of a video or a film may be batch-edited byapplying the same edits to each of the segments.

Playback window 515 is used to play back the edited version of avideo/film. In some embodiments, history window 507, which plays backthe original, unedited version of the video/film, and playback window515 can play the edited and unedited versions of the video/filmsimultaneously. In some embodiments, bar 511 serves to synchronize audioto one or more video frames.

FIG. 6 is an illustrative diagram showing a selection interface 600 forselecting one or more of multiple layer images in accordance with someembodiments of the disclosed subject matter. Referring to FIG. 6,selection interface 600 includes a history window 601, multiple layers603 of an input photo/image or a video frame (shown inside historywindow 601), and a menu bar 605.

In some embodiments, by displaying a side view with all layers relevantto, e.g., the input photo/image, selection interface 600 allows the userto select a layer to work on. For example, the user can move, merge,remove, group and manipulate the layers with a variety of editingfunctions. Selection interface 600 may also display a scroll view ofeach of the layers at the bottom of the interface. The scroll view maybe displayed together with a gallery view of multiple photos/images.

FIG. 7A-B are illustrative diagrams showing a lighting map interface 700for placing lighting effects on an image in accordance with someembodiments of the disclosed subject matter. Referring to FIG. 7A-B,lighting map interface 700 includes lights 701 emitting light 703 ofdifferent color and intensity, a lighting menu 705, and a preview window707.

Lighting map interface 700 allows the user to determine and simulate,based on manual input (e.g., through lighting menu 705) or light meterreading, the conditions of light surrounding an object. The user canplace one or more lights 701 in varying angles and locations and controlcharacteristics (e.g., color, intensity, etc.) of emitted light 703 fromeach light 701. Preview window 707 can display a preview of how anobject in the input photo/image/video frame may look under each lightcondition determined by the user.

FIG. 8 is an illustrative diagram showing a color gel selectioninterface 800 for selecting color gels and other filters in accordancewith some embodiments of the disclosed subject matter. Referring to FIG.8, color selection interface 800 includes a color wheel 801, a huepalette 803, and a preview window 805.

Gel color selection interface 800 allows the user to select color gelsand other filter elements to edit an input photo/image/video frame orone or more layers thereof. The user may select a color of a color gelusing color wheel 801. Once a color for the color gel is selected, huepalette 803 displays the pure hue and a plurality of variations of thepure hue for the selected color. Preview window 805 displays a previewof how the input photo/image/video frame, or one or more layers thereof,may look when the selected color and hue of the color gel is used tocast the color on the photo/image/video frame, or layers thereof. Theselected color gels may cast color as a projection from a lightingsource and this feature can also be used in the lighting map interface.

FIG. 9 is an illustrative image showing a gallery view interface 900 forselecting input images in accordance with some embodiments of thedisclosed subject matter. Referring to FIG. 9, gallery view interface900 displays a plurality of images 901. In some embodiments, the photos,images, or video frames represented by thumbnail images 901 in galleryview interface 900 are stored in a library of image/video portfolios.Gallery view interface 900 may be made as the default view.

In some embodiments, thumbnail images 901 are arranged by name.Thumbnail images 901 can be rearranged by user preferences, such asphoto-shoot date, subjects of images, theme, color, and the like.Editing tools may be accessed from gallery view interface 900. In someembodiments, a translucent editing interface can open over gallery viewinterface 900. Gallery view interface 900 can be switched to a portfoliomode in which a slide show of gallery images can be presented.

FIG. 10A-B are illustrative images showing the gallery view interfaceacting as a contact sheet 1000 for image enlargement and comparison inaccordance with some embodiments of the disclosed subject matter.Referring to FIG. 10, contact sheet 1000 displays one or more enlargedimages 1001 over thumbnail images, such as thumbnail images 901, e.g.,to compare multiple images side-by-side.

In some embodiments, touching, or single tapping, a thumbnail imageenlarges the image. Double tapping enlarged images 1001 may shrink theimages back to thumbnail images. If an enlarged image has been edited,the edited version of the image may be saved separately while theoriginal image remains intact. In some embodiments, a magnificationbubble appears where a tapping/touching is detected and provides amagnified preview of the image without enlarging the image tapped by theuser. The user can move the magnification bubble to inspect variousparts on the image, thereby removing the need for a magnifying loupe.

FIG. 11A-B are illustrative diagrams of a device 1100 embodying a systemfor creating multiple layer images from an input image in accordancewith some embodiments of the disclosed subject matter. FIG. 11A showsone side of device 1100 where a built-in projector 1103 is located.Projector 1103 allows visual presentations of the user's work. Projector1103 also allows the user (e.g., photographer) to edit, e.g.,photos/images, with a larger screen size and to map out placements forlighting. Device 1100 also include a display screen 1101 for displayingimages/photos/video frames as well as various user interfaces.

FIG. 11B shows the opposite side of device 1100 where a camera 1105 witha movable neck 1107 is located. Camera 1105 can be used to takepictures/images and save directly to device 1100. In some embodiments,camera 1105 is detachable and upgradeable. In some embodiments, the headof camera 1105 can swivel to allow for picture taking in any direction.

In some embodiments, an image layering application is installed and runon device 1100. The image layering application allows the user tocombine several images side-by-side to create panoramic images. Theimage layering application can also generate a plurality of layers froman input image.

The image layering application can preserve the transparency of each ofthe layers, as it was determined in creation, and renders the layerwithout adding additional opacity or filling in digitally what is neededto make the image opaque in printing. For example, a setting of 50%opacity means that only enough information will be transferred to renderit at that opacity.

The image layering application can provide a depth calculation tool todetermine the depth between the layers. In some embodiments, the imagelayering application allows for resizing of objects in an input image topreserve perspective as new layers are added.

The image layering application can also provide editing functions. Theuser may make batch edits, such as resizing multiple images, or applyingedits to a group of images or multiple sizes of one image. Effectsresulting from editing may be strewn across layers. For example, theeffects may be broken up and rendered on multiple layers determined bythe depth calculations of the image layering application. Effects placedon objects in an input image may be cast on all of the relevant layersin the scheme of the image based on the calculated depth. The effectscan be applied globally, or locally, thereby, e.g., affecting only onelayer or a highlighted region, or globally.

The image layering application may provide an exclusion feature suchthat the editing effects can be highlighted and deleted from specificlayers if they are not intended to influence the layers. For example,the exclusion feature can restore a layer to its state prior to theeffects.

The image layering application may also provide a history feature withlabel and settings for editing effects such that the user can deletespecific effects when editing on a trial and error basis or excludelayers from global effects. For example, history and undo functions maybe performed for individual layers as well as the entire image with aselective keep or discard function to remove one of the steps withoutaltering the edits performed after the removed step was taken.

In some embodiments, in which the image layering application runs on adevice, such as device 1100, the device can, while taking images,replicate various lens and camera attachments, such as macro, panoramic,fisheye, telephoto, infrared, or any other suitable lens and othercamera attachments. The device can also replicate photo printing effectsand finishes, such as antique, metallic, lithograph and the like, thatcan be applied to images or layers of an image. The device can alsoreplicate filters, such as color gels that cast color as a projectionfrom a lighting source, fog, polarizer, mist, sunset, and the like.

In some embodiments, the image layering application providesmulti-source lighting effects to create a 3-point shoot recreation withflexible overhead and 2-point positioning to recreate the physical setup of a professional photo shoot. The image layering application mayallow the user to create shadow points with the selection of objectpoints to indicate the height and mass of the objects in an image or alayer of an image.

The image layering application may provide color calibration settingsthat allow the user to print images on any printer. For example, theimage layering application may transmit color codes for each image to aprinter, tagging the image settings at the time of printout, so that theprinter settings can be adjusted to get the exact hues intended for theimage. The image layering application can indicate to the user whatsettings a printer should be set to for each image as well as a monitorcalibration printout to adjust a monitor to see an image clearly onscreen. For example, the calibration printout may include image details,such as color saturation, hues needed for each image, and brightness andcontrast settings, and the like.

The image layering application may also provide web design options thatallow for easy website generation and posting of images, e.g., for saleand viewing by the public (e.g., clients, etc.). In some embodiments,templates are supplied to the user with the tools necessary to createfunctional websites. Such templates may be updated by Internet downloadsor through upgrade packages. For example, gallery templates may beprovided with zoom options and visual samples of print packages for eachimage. Additionally, features, such as e-card, postcard, and calendaroptions can be provided.

The image layering application may provide light meter tools that allowthe user to determine the conditions of light in a photo shoot area. Forexample, the light meter tools may produce a reading of light levels forflash, exposure, ambient, and cine levels, thereby replacing the needfor light meters.

The image layering application may also provide a lighting map thatallows the user a 3-dimensional view of a photo shooting area and objectplacement in scale in a mock layout. The light map can be viewed inmultiple angles to see a mock view of how and under what conditions(e.g., underwater, sunrise, noon, dusk, sunset, night shoots, overcastconditions, or closed set) light would fall so that the user can planfor contingencies.

Prompts may be provided to request details when light meter is not usedto determine the light conditions. For example, windows for typing inmanual settings can be provided for the expected conditions of a photoshooting space. Settings may be saved by locations. In some embodiments,the image layering application provides a GPS tool that can be used toadd location details to each saved location. In some embodiments, thetype of light can be chosen from a series of options, such as spotlightor directional light and soft box with wattage settings for the strengthof each light, which can be modified once in place on the lighting map.The image layering application can provide prompts for natural lightoptions to input the time of day, outdoors or indoors, placement ofwindows, doors, and the like.

A divider feature would allow the user to divide and manipulate objectswithin one layer and keeps them in that one layer without altering theunaffected objects. The software would allow the user to move objectsindependently after selected within one layer. A selection feature wouldallow the user to select objects in multiple layers and allow the userto move or apply edits to those selected objects independently in theirrespective layers without altering unselected objects within thoselayers and would allow the user to select multiple layers to move orapply edits to in their entirety. An alignment feature would allow theuser to select objects on multiple layers and line them up accuratelyalong a designated line by letting the user select and highlight objectsand then draw a line to align them along. A gradient sizing featureallows the user to align objects on multiple layers along a designatedline drawn by the user and puts the objects in perspective along thatline by resizing the objects in a gradual degree to match the sizingdesignated by a secondary line that is drawn in relation to the first.

A feature would allow the user to group and merge layers to condense thenumber of layers with the ability to ungroup them, in part orcompletely, to return them to individual layers again. The ability tocopy the grouped or merged layer to other files with the same ability toungroup them and return them to individual layers after having beengrouped in another file or within the same file would also be a featureof the software. In both instances transferring or copying the groupedlayers to another file would not flatten the image and they would retainthe data content to allow them to be reconstituted as separate layerseven after being copied to a file without their editing history. Historydata, such as edits and data of the files prior to grouping would betransferred or copied with them to allow them to be reconstituted asindividual layers with the ability to access their edit history. Thesoftware would provide the allocation of edit history data to each ofthe individual layers and the ability to access the layers individualedit history independently, to apply or undo edits, without affectingthe history of other layers within the image along with the ability toselect and remove multiple edits from the edit history withspecification to object, layer, and whether to be globally or locallyapplied. Effects can be applied across multiple layers in perspective inthe context of the image as a whole and not based solely on the scale orperspective of the individual layer (e.g. Casting shadows in an imagewith multiple objects at different depths in perspective. Adding theshadow to an object in the context of an individual layer may cast itsmall and short but in the context of the whole room, with lighting andbeing cast across multiple surfaces and objects, it can be larger.). Thesoftware will include a neon pen feature to allow the user to draw inphotography lighting effects that mimic the streaks of light in a movingimage, such as when lighted objects are photographed moving at fastspeed.

Although the invention has been described and illustrated in theforegoing illustrative embodiments, it is understood that the presentdisclosure has been made only by way of example, and that numerouschanges in the details of implementation of the invention can be madewithout departing from the spirit and scope of the invention. Featuresof the disclosed embodiments can be combined and rearranged in variousways.

What is claimed is:
 1. A non-transitory computer readable storage mediumstoring computer executable instructions that, when executed on aprocessor, cause the processor to perform a method for editing aplurality of layer images of an input image, the method comprising:displaying a photo editing interface to allow a user to apply at leastone edit to at least one of the plurality of layer images; wherein theat least one editing function includes an alignment feature that wouldallow the user to select objects on multiple layers and line them upaccurately along a designated line by letting the user select andhighlight objects and then draw a line to align them along.
 2. Thenon-transitory computer readable storage medium according to claim 1,wherein the at least one editing function includes a gradient sizingfeature allows the user to align objects on multiple layers along adesignated line drawn by the user and puts the objects in perspectivealong that line by resizing the objects in a gradual degree to match thesizing designated by a secondary line that is drawn in relation to thefirst.
 3. The non-transitory computer readable storage medium accordingto claim 1, wherein the at least one editing function includes agrouping feature to allow the user to group or merge layers with theability to ungroup them, in part or completely, to return them toindividual layers again.
 4. The grouping feature according to claim 3,wherein the at least one editing function includes the ability to copythe grouped or merged layers within the same file or to other files withthe ability to ungroup and return them to individual layers and wherecopying the grouped layers would not flatten the image and would retainthe history data.
 5. The grouping feature, according to claim 4, whereinthe method further comprises the transfer of edit history data with thelayers as a group, merged, or as individual layers when copied to allowthem to be reconstituted as individual layers with the ability to accesstheir edit history.
 6. The history data, according to claim 4, whereinthe method further comprises the allocation of edit history data to eachof the individual layers and the ability to access the layers individualedit history independently, to apply or undo edits, without affectingthe history of other layers within the image.
 7. The history data,according to claim 4, wherein the method further comprises the abilityto select and remove multiple edits from the edit history withspecification to object, layer, and whether to be globally or locallyapplied.
 8. The non-transitory computer readable storage mediumaccording to claim 1, wherein the at least one editing function includesa divider feature that allows the user to divide and manipulate objectswithin one layer and keeps them in that one layer without altering theunaffected objects.
 9. The non-transitory computer readable storagemedium according to claim 1, wherein the at least one editing functionwould allow the user to move objects independently after selected withinone layer.
 10. The non-transitory computer readable storage mediumaccording to claim 1, wherein the at least one editing function includesa selection feature that allows the user to select objects in multiplelayers and move or apply edits to those selected objects independentlyin their respective layers without altering unselected objects withinthose layers and allows the user to select multiple layers to move orapply edits to in their entirety.
 11. The non-transitory computerreadable storage medium according to claim 1, wherein the at least oneediting function includes a feature to add color to a selected objectwithin an image based on the gradations of color and shadows within theobject.
 12. The non-transitory computer readable storage mediumaccording to claim 1, wherein the at least one editing function includesa neon pen feature.
 13. The non-transitory computer readable storagemedium according to claim 1, wherein at least one editing functionincludes applying effects across multiple layers in perspective in thecontext of the image as a whole.